Design of a Distributed Reachability Algorithm 
for Analysis of Linear Hybrid Automata 



Sumit Kumar Jha 

Computer Science Department, Carnegie Mellon University, Pittsburgh PA 15213 



Abstract. This paper presents the design of a novel distributed algo- 
rithm d-IRA for the reachability analysis of linear hybrid automata. Re- 
cent work on iterative relaxation abstraction (IRA) is leveraged to dis- 
tribute the computational problem among multiple computational nodes 
in a non-redundant manner by performing careful infeasibility analysis of 
linear programs corresponding to spurious counterexamples. The d-IRA 
algorithm is resistant to failure of multiple computational nodes. The ex- 
perimental results provide promising evidence for the possible successful 
application of this technique. 



1 Introduction 

The verification of hybrid systems is a computationally expensive proce- 
dure and often does not succeed except for systems with a few continu- 
ous variables. Linear hybrid automata are an important class of hybrid 
systems which can approximate nonlinear hybrid systems in an asymp- 
totically complete fashion [2]. We extend earlier work [3] on applying 
counterexample guided abstraction refinement (CEGAR) algorithms to 
the analysis of linear hybrid automata and present a distributed algo- 
rithm for their reachability analysis. 

We believe that a distributed analysis engine for hybrid automata will 
be an important achievement in the area of analyzing hybrid systems. 
There are two important developments that motivate our research in this 
direction: 

— While the computational power on a single core processor had tradi- 
tionally been growing exponentially, recent trends cite [intel, amd] 
by microprocessor manufacturers have clearly indicated that this 
exponential growth is no longer feasible. This requires that compu- 
tational systems adapt to the hardware systems that are going to be 
available in the future. While efficient compiler and hardware tech- 
niques were successful at finding parallelism in programs running on 
a single core processor, the advent of multiple processors on a single 
chip puts the burden of finding parallelism more on the designer of 
the algorithm and the architect of the software system. In particular, 
software systems and the algorithms they implement must explicitly 
provide opportunities for multiple cores to be in use simultaneously. 



— Borrowing techniques from the domain of linear programming and 
ideas from the realm of practically applied software verification, we 
have recently proposed an iterative relaxation abstraction technique 
which exploits the structure of a linear hybrid automata while try- 
ing to solve its reachability analysis problem. The IRA algorithm 
is based on solving several smaller sub-problems one after another 
instead of solving the original problem at once. Further reflection 
shows that several subproblems being constructed can be built and 
solved in a distributed manner, with a relatively small amount of 
book keeping and further algorithmic analysis. 

This paper makes several novel contributions to the development of prac- 
tical algorithms for the analysis of linear hybrid automata: 

1. We present the first distributed algorithm for the analysis of linear 
hybrid automata. Our algorithm is tolerant of multiple failures in the 
distributed computational nodes. 

2. We present new theoretical results establishing a partial-order among 
counterexamples and relaxations of linear hybrid automata. Using these 
results, we find several counterexamples not related by the partial order 
and build relaxations to refute each of them in a distributed manner. 

3. We show that the distributed system has a small global state which 
needs to be preserved in case of failure of the distributed system; we also 
identify the potential to backup this global state without slowing down 
the distributed computation. 

2 Related Work 

The reachability analysis algorithms for linear hybrid automata have 
been studied in [2], . These algorithms continue to be the driving horse 
for PHAVer [T], IRA [3] and our current techniques too. We have built 
upon these core algorithms and did not intend to replace them. 
Our current work is inspired by our development and analysis of several 
LHA examples using the IRA algorithm, which is now re-implemented 
within PHAVer. The IRA algorithm is essentially a CEGAR based tech- 
nique for analyzing Linear Hybrid Automata (LHA). IRA introduces 
the idea of constructing multiple relaxations of an LHA and proves the 
reachability property over the original LHA using these relaxations. Each 
relaxation of the LHA is an over-approximate abstraction for the LHA 
but the relaxed LHA often involves relatively fewer number of contin- 
uous variables and is, hence, more amenable to analysis. First, IRA [3] 
constructs a relaxation Hi of the LHA H . It then queries the underlying 
LHA reachability engine like PHAVer [I] and builds an over-approximate 
discrete abstraction ( a regular language FSM ) Ai for the relaxed hybrid 
automata Hi. If the language of the over-approximate discrete abstrac- 
tion contains no counterexamples, the bad state is not reachable in the 
original LHA either and the algorithm terminates. Otherwise, IRA picks 
up a counterexample from the discrete abstraction and constructs a linear 
program to check for its validity in the high dimensional original linear 



hybrid automata. If the linear program is satisfiable, the counterexam- 
ple is valid [4j and hence, the IRA algorithm reports that the bad sate is 
reachable and stops. Otherwise the linear program is infeasible, a small 
subset of variables is identified using infeasibility analysis and a new re- 
laxed hybrid automata Hi+i is constructed using these variables. This 
standard algorithm is discussed in [3]. 

Our experience with the development and analysis of examples using our 
tool IRA showed that several expensive computations performed by the 
IRA reachability engine can be performed independently in a distributed 
manner. 

3 The Distributed Algorithm (d-IRA) 

In this paper, we present a distributed version of the IRA algorithm. The 
flow of the algorithm is sketched in Fig. [T] The distributed algorithm 
assumes one master computation node and (N-l) other computational 
(slave) nodes. Initially, the master node initialises a counter i to zero, 
chooses the empty set as an initial set of variables To and learns the 
deterministic finite automata corresponding to E* as the initial discrete 
over-approximate global abstraction of the language of the LHA H. 

1. During the iteration, the j th computational node constructs its own 
relaxation H{ of the linear hybrid automata H using the set of variables 
If. It should be noted that the process of constructing relaxations may 
also be computationally very intensive and may involve invoking the 
Fourier-Motzkin elimination routine. 

2. Each computational node then constructs a discrete abstraction Temp 1 
corresponding to the relaxed linear hybrid automata H\. This step in- 
volves making calls to the underlying reachability engine like PHAVer [I] . 
Both the above steps are identical to the corresponding steps in the IRA 
algorithm [3] and are not discussed here for brevity. 

3. Each computational node sends the discrete abstraction Temp 1 which 
it learned from the relaxed linear hybrid automata Hi to the master com- 
putational node. This is the only step at which there is communication 
from the slave nodes to the master node during the d-IRA algorithm. 

4. The master node updates the discrete global abstraction A 1 ^ by taking 
the intersection of the previous discrete global abstraction A l CE with all 
the newly learned discrete abstractions Temp 3 . 

5. Then, the master picks a set CE of N non-redundant counterexam- 
ples from the newly built discrete global abstraction A 1 ^. This is an 
algorithmically interesting step and is detailed in Section 2] 

6. The master node checks if the set of counterexamples CE is empty. 
If A 1 qe has no counterexamples, then no bad states are reachable in the 
system [5] and hence, it is declared to be safe. 

7. The master computational node forms a set of linear programs C, 
where each linear program corresponds to one of the counterexamples 
in CiJi+i. This step is similar to the corresponding step in the IRA 
algorithm [3] and is discussed in depth in [4]. 

8. The master node checks if any of the linear programs in C is feasible. 
In any of them, say C, is feasible, we stop and report that the bad state 




Fig. 1. The d-IRA procedure: Distributed Iterative Relaxation Abstraction. 
Note that the expensive calls to the underlying hybrid automata reachability 
engine occurs in parallel. 



is reachable [3]. We also report the counterexample corresponding to the 
linear program C. 

9. If none of the linear program are feasible, the master node finds the 
irreducible infeasible subsets for each of the linear programs. 

10. The master node uses the basis of the IIS as the choice for the next 
set of variables Xj+i which will be used to construct the relaxations. The 
master node communicates the set P i+1 to the j client. This is the only 
step in the d-IRA algorithm during which the master sends messages to 
the client nodes. 

10. The master then increment the counter i and goes back to the dis- 
tributed computation at Step 2. 

4 A Partial Order for Counterexamples and 
Relaxations 

In order to make the distributed computation effective, it is essential that 
the various computational nodes do not solve equivalent reachability sub- 
problems. In particular, we want to make sure that the relaxed linear 
hybrid automata for the i th iteration Hi and are different We 
achieve this goal by making a suitable choice of counterexamples from 
the global abstraction Aq~ e . Before we present our algorithmic methods, 
we define some related notions. Our definitions of linear hybrid automata, 
relaxations and counterexamples are identical to those in literature [213] 
and we do not repeat them here for sake of brevity. Given a path p in 
a linear hybrid automata H, we can derive a set of corresponding linear 
constraints Constraints(H , p) which is feasible if and only if the path is 
feasible. This construction 4 3 is omitted here. 

Definition 1. Minimal Explanation for Infeasible Counterexamples : 
Given a counterexample path p which is infeasible in a linear hybrid au- 
tomata H but feasible in a relaxation H' of H , (i.e. H' jZ H), a set of 
linear constraints IIS(p) is said to be an IIS for p if and only if: 

— IIS(p) C Constraints^!!, p) 

— IIS(p) is not feasible. 

— for any set S s.t. S C IIS(p), S is feasible. 

The special basis Var of the IIS of p is called a minimal explanation for 
the infeasible counterexample and we write it as Var(p,IIS(p)). 

In the following, we assume that there exists a function ITS which maps 
each counterexample to a unique IIS. 

Definition 2. Dominance of Counterexamples : A counterexample ce is 
said to dominate a counterexample ce' if and only if V ar(ce,TTS(ce)) C 
Var(ce' ,TT <S(ce')). We write ce>ce'. 

We now define the notion of equivalent counterexamples and show that 
dominance relation among counterexamples forms a partial order. 

We note that the property of IRA that no two relaxations across the iterations are 
identical still holds and with the same proof 



Definition 3. Two counterexamples ce and ce' are said to be equivalent 
if and only ifVar(ce,XXS(ce)) — Var(ce' ,XXS{ce')). Then, we say ce ~ 
ce'. 

Theorem 1. The dominance relation y among counterexamples is a 
partial order relation. 

Proof. We prove that y is reflexive, antisymmetric and transitive: 
Reflexivity: For every counterexample, Var(ce,XXS(ce)) C Var(ce,XXS(ce)); 
hence, ce y ce. 

Antisymmetry: Suppose ce y ce' and ce' y ce. Then, Var(ce,XXS(ce)) 
C Var(ce' , XXS(ce')), and also, Var(ce' ,XXS(ce')) C Var(ce,XXS(ce)). 
Thus, Var(ce,XXS(ce)) = Var(ce' ,XXS(ce')). Hence, ce « ce'. 
Transitivity: Suppose ce >; ce' and ce' ce", then l/ar(ce, XXS(ce)) C 
Var(ce',JJ5(ce')) and Var(ce', T1S{ce')) C Var(ce", XXS(ce")). Thus, 
Var(ce, llS{ce)) C Var(ce", XXS(ce")). Hence, ce ^ ce". 

Theorem 2. TTie relaxations {Hi} of H form a partial order. 

Proof. We prove that the relaxation relation C among i/; is a partial 
order. Reflexivity: For every relaxed hybrid automata, i/i IZ iJj. ylnti- 
symmetry: Suppose iJi C //j and ffj IZ Hi. Then, Hi = Hj. Transitivity: 
Suppose Hi C and i/j C i/fe, then C _fffc. 

Theorem 3. Let H ce be the relaxation of H w.r.t. Var(ce, XX <S(ce)) and 
ff ce / he i/ie relaxation of H w.r.t. Varice' ,XXS(ce')). If the counterex- 
ample ce dominates the counterexample ce' i.e. ce y ce' , then H ce is a 
relaxation of H ce i i. e. H ce C H ce i . 

Proof. Since ce ce', Var(ce,XXS(ce)) C Var(ce' ,XXS(ce')). Thus, 

Ace ^Var(ce,XXS(ce))\Var(ce' ,XXS{ce')) H ce i \—y ar ( ce ' ,IXS(ce' ) ) 

The algorithm for selecting N counterexamples is based on the above 
results. 



Algorithm Select.CE 

fnput: Global Abstraction Automata A l CE , LHA H, a timer TfME- 
OUT. 

Output: N counterexamples: CE = {cei, . . . cejv} 

1. Initialize CE to be the empty set. 

2. Pick a set of m (> N) distinct counterexamples C = {cei, ce2 . . . ce m } 
from Aq E . 

3. Build a set of linear programs {Ipi, Ipi ■ ■ ■ Ipm} corresponding to each 
of {cei, ce2 . . . ce m } 

4. For each (infeasible) linear program Ipi, obtain an IIS and remember 
it as XXS(lpi) 

5. For each counterexample cei £ C, 

a. Check whether there exists a counterexample cej G C such that 
cej y ce, (i^j). 

b. If no such counterexample cej exists, add ce; to CE. 

c. Remove Cd from C. 

6. If ( \CE\ < N and [TIMEOUT ) , m = m x 2 ; goto step 2. 

7. Assert (|CS| > N or TIMEOUT); RETURN the first N members 
of CE as a set. 



5 Properties and Extensions of d-IRA 



Theorem 4. The d-IRA algorithm is resistant to failures and restarts 
of all slave nodes. 

Proof. If the i th slave node fails during the j th iteration, then the d-IRA 
algorithm can still proceed by making the assumption that L(Tempi) — 
S* . When the i th node has recovered, it can continue to participate from 
the next iteration. 

The resistance to failures of slave computational nodes is possible be- 
cause the slave nodes do not store any global state information during 
the distributed computation and the overall distributed reachability com- 
putation itself does not depend critically on one or more slave nodes. It 
is also to be noted that the communication bandwidth is bounded by 
the sum of the sizes of the discrete abstractions and the variable sets at 
each stage. 

Tolerance to Failure of Master Computation Node The d- 

IRA algorithm depends critically on the master computational node and 
its failure would prematurely end the distributed computation. While 
master nodes could be chosen to be very reliable, the algorithm can also 
be adapted to handle unreliable master nodes. 

It is to be observed that the d-IRA algorithm spends most of its time 
performing relaxations and reachability computations during which the 
communication infrastructure would remain idle. Further, the current 
state of the distributed computation is really captured completely by 
the global abstraction A l CB after the i th iteration. It is hence desirable to 
communicate the global abstraction to either a group of shadow masters 
or to the slave machines themselves during periods of low communication 
activity. In such a scenario, the failure of the master node would only 
require that an old copy of the global abstraction A % CE be obtained from 
one of the shadow masters or the slave machines. Then, the distributed 
computation would restart without wasting the computations already 
completed in the first i iterations. 

Theorem 5. The modified d~IRA algorithm is resistant to failures and 
restarts of the master node. 

6 Experimental Results and Conclusion 

We implemented a version of our distributed algorithm using the IRA 
infrastructure. We ran our experiments on a four processor 64-bit AMD 
Opteron(tm) 844 SMP machine running Red Hat Linux version 2.6.19.1- 
001-K8. We only implemented a parallel version of the relaxation step 
to test the validity of these ideas. We found up to a 3.41-X increase in 
performance on our four processor machine with this implementation on 
a set of parameterized adaptive cruise control examples [3]. 



Table 1. Distributed IRA vs IRA 



Example jj- Variables Time for d-IRA [s] Time for IRA [s] 



ACC-4 
ACC-8 
ACC-16 
ACC-19 



19 



16 



4 



8 



2438 



1057 



100 



11 



3839 



9752 



192 



15 



A case for the architecture of a distributed hybrid systems model checker 
has been made in this paper which uses the partial order relation among 
multiple counterexamples obtained during the Iterative Relaxation Ab- 
straction procedure for the generation of non-redundant distributed sub- 
problems. 
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Preface 



This textbook is intended for use by students of physics, physical chemistry, 
and theoretical chemistry. The reader is presumed to have a basic knowledge 
of atomic and quantum physics at the level provided, for example, by the first 
few chapters in our book The Physics of Atoms and Quanta. The student of 
physics will find here material which should be included in the basic education 
of every physicist. This book should furthermore allow students to acquire an 
appreciation of the breadth and variety within the field of molecular physics and 
its future as a fascinating area of research. 

For the student of chemistry, the concepts introduced in this book will provide 
a theoretical framework for that entire field of study. With the help of these con- 
cepts, it is at least in principle possible to reduce the enormous body of empirical 
chemical knowledge to a few basic principles: those of quantum mechanics. In 
addition, modern physical methods whose fundamentals are introduced here are 
becoming increasingly important in chemistry and now represent indispensable 
tools for the chemist. As examples, we might mention the structural analysis of 
complex organic compounds, spectroscopic investigation of very rapid reaction 
processes or, as a practical application, the remote detection of pollutants in the 
air. 
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1 Fixed-Period Problems: The Sublinear Case 

With this chapter, the preliminaries are over, and we begin the search for periodic 
solutions to Hamiltonian systems. All this will be done in the convex case; that 
is, we shall study the boundary-value problem 

x = JH'(t,x) 
x(0) = x(T) 

with H(t, •) a convex function of x, going to +00 when ||x|| — ► 00. 
1.1 Autonomous Systems 

In this section, we will consider the case when the Hamiltonian H(x) is au- 
tonomous. For the sake of simplicity, we shall also assume that it is C x . 

We shall first consider the question of nontriviality, within the general frame- 
work of (^4oo, i?oo)-subquadratic Hamiltonians. In the second subsection, we shall 
look into the special case when H is (0, 6 oc )-subquadratic, and we shall try to 
derive additional information. 

The General Case: Nontriviality. We assume that H is {A^, _B oc )-sub- 
quadratic at infinity, for some constant symmetric matrices A^ and B^, with 
Boo — Aoo positive definite. Set: 



7 : = smallest eigenvalue of — A, 



00 



(1) 



A : = largest negative eigenvalue of J— + A, 



dt 



OO 



(2) 



Theorem ?? tells us that if A + 7 < 0, the boundary- value problem: 

x = JH'{x) 
x(0) = x{T) 



(3) 



has at least one solution x, which is found by minimizing the dual action func- 
tional: 

rT 



±(A?u,u)+N*{-u) 



dt 



(4) 



on the range of A, which is a subspace R(A)\ with finite codimension. Here 



N{x) := H{x) - - {A^x^x) 



is a convex function, and 

N(x) < i ((Boo -Aoo)x,x) +c \fx . 
Proposition 1. Assume H'(0) = and H(0) = 0. Set: 



S := liminf 2N(x) \\x 

7/7 < —A < S, the solution u is non-zero: 

x{t) ± Vt . 



1-2 



(5) 



(6) 



(7) 



(8) 



Proof. Condition (??) means that, for every 8' > 6, there is some e > such 
that 



6'.. ,.2 



\\x\\ < e => N(x) < — \\x 



(9) 



It is an exercise in convex analysis, into which we shall not go, to show that 
this implies that there is an r\ > such that 



f\\x\\< V ^N*(y)<—\\y 



(10) 



Fig. 1. This is the caption of the figure displaying a white eagle and a white horse on 
a snow field 
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Since u\ is a smooth function, we will have H/imiH^ < i] for h small enough, 
and inequality (??) will hold, yielding thereby: 



ip(hut) < \\ \\ Ul \\l + ^-^ ||ui|| 2 



(11) 



If we choose 5' close enough to S, the quantity ( j + jr) will be negative, and 
we end up with 

ij){hu{) < for h ^ small . (12) 

On the other hand, we check directly that tp(0) = 0. This shows that cannot 
be a minimizer of tjj, not even a local one. So u ^ and u ^ A~ 1 (0) = 0. □ 

Corollary 1. Assume H is C 2 and (doo, &oo) -subquadratic at infinity. Let £i, 
...,£n be the equilibria, that is, the solutions of H'(£) = 0. Denote by uik the 
smallest eigenvalue of H" (£fc), and set: 



uo := Min {u)\, . . . , w*;} 



T 



(13) 
(14) 



then minimization of tp yields a non-constant T -periodic solution x. 



We recall once more that by the integer part E[a] of a G H, we mean the 
a e 7Z such that a < a < a + 1. For instance, if we take = 0, Corollary 2 
tells us that x exists and is non-constant provided that: 



2^ 6 ~ <1< 2^ 



or 



T G 



2tt 2tt 



(15) 
(16) 



Proof. The spectrum of A is 1^.2? + a^. The largest negative eigenvalue A is 
given by + a^, where 



— A: + aoo < < — (k„ + 1) + a c 



Hence: 

The condition 7 < —A < S now becomes: 

2tt 



aoo < 



k a - < lu - a a 



which is precisely condition (??). 



(17) 
(18) 

(19) 
□ 
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Lemma 1. Assume that H is C 2 on R 2 ™\{0} and that H"(x) is non-degenerate 
for any x ^ 0. Then any local minimizer x of ip has minimal period T. 

Proof. We know that x, or x + £ for some constant £ G H 2 ™, is a T-periodic 
solution of the Hamiltonian system: 

x = JH'(x) . (20) 

There is no loss of generality in taking £ = 0. So ip(x) > i[)(x) for all x in 
some neighbourhood of x in IT 1 ' 2 (TR/T2Z; IR 2 ™). 

But this index is precisely the index ix{x) of the T-periodic solution x over 



the interval (0,T), as defined in Sect. 2.6. So 

ir(x) - . (21) 
Now if x has a lower period, T/k say, we would have, by Corollary 31: 

i T (x) = i kT/k (x) > ki T/k (x) + k-l>k-l>l . (22) 
This would contradict (??), and thus cannot happen. □ 



Notes and Comments. The results in this section are a refined version of [?] ; the 
minimality result of Proposition 14 was the first of its kind. 

To understand the nontriviality conditions, such as the one in formula (??), 
one may think of a one-parameter family xt, T G (27rw _1 , 2irb^) of periodic 
solutions, xt(0) = %t(T), with xt going away to infinity when T — > 2irui~ 1 , 
which is the period of the linearized system at 0. 

Table 1. This is the example table taken out of The T^Xbook, p. 246 



Year 


World population 


8000 B.C. 


5,000,000 


50 A.D. 


200,000,000 


1650 A.D. 


500,000,000 


1945 A.D. 


2,300,000,000 


1980 A.D. 


4,400,000,000 



Theorem 1 (Ghoussoub-Preiss). Assume H(t,x) is {Q 1 e)-subquadratic at 



infinity for all e > 0, and T-periodic in t 

H(t, •) is convex Vi (23) 

H(-,x) is T-pcriodic Vx (24) 

H(t,x) > n(\\x\\) with n(s)s^ 1 — > oo as s — > oo (25) 
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Ve>0, 3c : H(t,x) < ^\\xf + c . (26) 

Assume also that H is C 2 , and H"(t, x) is positive definite everywhere. Then 
there is a sequence Xk, k <E IN, of kT -periodic solutions of the system 

x = JH'(t,x) (27) 

such that, for every k G IN, there is some p a € IN with: 

P>Po=>x pk ^x k . (28) 

□ 

Example 1 (External forcing ). Consider the system: 

x = JH'{x) + f(t) (29) 

where the Hamiltonian H is (0, &oo)-subquadratic, and the forcing term is a 
distribution on the circle: 

f=j t F + f with FeL 2 (M/T2Z; IR 2 ™) , (30) 
where f a := T _1 f(t)dt. For instance, 

/(*) = E s *z > ( 31 ) 

feeiN 

where S k is the Dirac mass at t = k and £ G IR 2 " is a constant, fits the pre- 
scription. This means that the system x = JH'(x) is being excited by a series 
of identical shocks at interval T. 

Definition 1. Let A^it) and i?oo(£) be symmetric operators in JR 2n , depending 
continuously on t G [0, T], such that ^(t) < B^t) for all t. 

A Borelian function H : [0, T] x JR 2n — > IR is called (A^, B^-subquadratic 



at infinity if there exists a function N(t, x) such that: 

H(t,x) = ^{A 00 {t)x,x)+N(t,x) (32) 

Vi , N(t, x) is convex with respect to x (33) 

N(t,x) > n(\\x\\) with n(s)s^ 1 -> +oo as s -> +oo (34) 

BcelR: H(t,x)<^(B 00 (t)x,x)+c Vx . (35) 



If A^t) = aool and B^t) = b^I , with < G 1R ; we shall say that 
H is (aocb^-subquadratic at infinity. As an example, the function \\x\\ a , with 
1 < a < 2, is (0, e)-subquadratic at infinity for every e > 0. Similarly, the 
Hamiltonian 

H{t,x) = ^k\\k\\ 2 + \\x\\ a (36) 
is (k, k + e)-subquadratic for every e > 0. Note that, if k < 0, it is not convex. 
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Notes and Comments. The first results on subharmonics were obtained by Ra- 
binowitz in [?] , who showed the existence of infinitely many subharmonics both 
in the subquadratic and superquadratic case, with suitable growth conditions 
on H'. Again the duality approach enabled Clarke and Ekeland in [?] to treat 
the same problem in the convex-subquadratic case, with growth conditions on 
H only. 

Recently, Michalek and Tarantello (see [?] and [?]) have obtained lower bound 
on the number of subharmonics of period kT, based on symmetry considerations 
and on pinching estimates, as in Sect. 5.2 of this article. 
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1 Fixed-Period Problems: The Sublinear Case 

With this chapter, the preliminaries are over, and we begin the search for periodic 
solutions to Hamiltonian systems. All this will be done in the convex case; that 
is, we shall study the boundary-value problem 

x = JH'(t,x) 
x(0) = x(T) 

with H(t, •) a convex function of x, going to +oo when ||x|| — ► oo. 
1.1 Autonomous Systems 

In this section, we will consider the case when the Hamiltonian H(x) is au- 
tonomous. For the sake of simplicity, we shall also assume that it is C . 

We shall first consider the question of nontriviality, within the general frame- 
work of (Am, -Boo)-subquadratic Hamiltonians. In the second subsection, we shall 
look into the special case when H is (0, fe^-subquadratic, and we shall try to 
derive additional information. 

The General Case: Nontriviality. We assume that H is {A^, B^-sub- 
quadratic at infinity, for some constant symmetric matrices A^ and B^, with 
Bqc — Aoo positive definite. Set: 



7 : = smallest eigenvalue of B x — A, 



oc 



(1) 



A : = largest negative eigenvalue of J— + A, 



dt 



(2) 



Theorem 21 tells us that if A + 7 < 0, the boundary-value problem: 



x = JH'(x) 
x(0) = x(T) 



(3) 



has at least one solution x, which is found by minimizing the dual action func- 
tional: 

" ~1 



ip(u) 



-(A^u,u)+N*(-u) 



dt 



(4) 



on the range of A, which is a subspace R(A) 2 L with finite codimension. Here 



N(x) :=H(x)--(A oc x,x) 



is a convex function, and 



(5) 



N(x) <-((B 00 -A 00 )x,x)+c Vx 

Proposition 1. Assume H'(0) = and H(0) = 0. Set: 

5 := lim inf 2N(x) \\x\\~ 2 . 

If 7 < —A < d, the solution u is non-zero: 

x{t) ^0 Vt . 



(6) 



(7) 



(8) 



Proof. Condition (??) means that, for every 8' > S, there is some e > such 
that 

\\x\\<e^N(x)< S -\\x\\ 2 . (9) 

It is an exercise in convex analysis, into which we shall not go, to show that 
this implies that there is an r\ > such that 



fM<V^N*(y)<±\\yf 



(10) 



Fig. 1. This is the caption of the figure displaying a white eagle and a white horse on 
a snow field 

Since u\ is a smooth function, we will have H/iuiH^ < f] for h small enough, 
and inequality (??) will hold, yielding thereby: 

^i)<yi|hii||^ + y^|| U i|| 2 • (11) 
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If we choose 6' close enough to 6, the quantity ( j + jr) will be negative, and 
we end up with 

ipihm) < for h ^ small . (12) 

On the other hand, we check directly that ip(0) = 0. This shows that cannot 
be a minimizer of ■0, not even a local one. Som^O and u ^ A~ 1 (0) = 0. □ 

Corollary 1. Assume H is C 2 and {a^, boo) -subquadratic at infinity. Let £i, 
. . . , £jv be the equilibria, that is, the solutions of H' '(£) = 0. Denote by uik the 
smallest eigenvalue of H" (£k), an d se t : 



:= Min {ui, . . . ,Lu k } . 



If: 



2tt 



2tt 



T 



(13) 
(14) 



then minimization of tp yields a non-constant T -periodic solution x. 



We recall once more that by the integer part E[a] of a £ H, we mean the 
a e 2Z, such that a < a < a + 1. For instance, if we take aoo = 0, Corollary 2 
tells us that x exists and is non-constant provided that: 



or 



T , T 
— boo < 1 < ^~ 
2tt 2tt 



/ 2tt 2vr 

Te — r- 



(15) 



(16) 



Proof. The spectrum of yl is + a^. The largest negative eigenvalue A is 

given by ^fc Q + a^, where 



27T 27T., 

— + aoo < < — \ k o + 1) + Ac 



Hence: 



K = E 



T 



The condition 7 < —A < 5 now becomes: 



2tt, 



aoo < -^7^0 - aoo < w - a 



which is precisely condition (??). 



(17) 
(18) 

(19) 
□ 



Lemma 1. Assume that H is C 2 on TR 2n \{0} and that H"(x) is non-degenerate 
for any x ^ 0. Then any local minimizer x of ip has minimal period T. 
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Proof. We know that x, or x + £ for some constant £ e H n , is a T-periodic 
solution of the Hamiltonian system: 

x = JH'(x) . (20) 

There is no loss of generality in taking £ = 0. So ip(x) > ip(x) for all x in 
some neighbourhood of x in W 1 ' 2 (M/TZZ; H 2 ™). 

But this index is precisely the index ir{x) of the T-periodic solution x over 
the interval (0, T), as defined in Sect. 2.6. So 

ir(x) = . (21) 

Now if x has a lower period, T/k say, we would have, by Corollary 31: 

*t(x) = i kT /k{x) > ki T/k (x) + k - 1 > k - 1 > 1 . (22) 

This would contradict (??), and thus cannot happen. □ 

Notes and Comments. The results in this section are a refined version of ?; the 
minimality result of Proposition 14 was the first of its kind. 

To understand the nontriviality conditions, such as the one in formula (??), 
one may think of a one-parameter family xt, T e (27ra; -1 , 27r&^ 1 ) of periodic 
solutions, Xt(0) = %t(T), with xt going away to infinity when T — > 2iruj~ 1 , 
which is the period of the linearized system at 0. 



Table 1. This is the example table taken out of The TgXbook, p. 246 



Year 


World population 


8000 B.C. 


5,000,000 


50 A.D. 


200,000,000 


1650 A.D. 


500,000,000 


1945 A.D. 


2,300,000,000 


1980 A.D. 


4,400,000,000 



Theorem 1 (Ghoussoub-Preiss). Assume H(t,x) is (0, s)-subquadratic at 
infinity for all e > 0, and T-periodic in t 

H(t, •) is convex Vt (23) 

H(-,x) is T-pcriodic Vx (24) 
H(t,x) > n(\\x\\) with n(s)s^ 1 — > co as s — > co (25) 

Ve>0, 3c : H(t,x) <^\\xf + c . (26) 
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Assume also that H is C 2 , and H"(t, x) is positive definite everywhere. Then 
there is a sequence Xk, fc £ IN, of kT -periodic solutions of the system 

x = JH'(t,x) (27) 

such that, for every k £ IN, there is some p £ IN with: 

P> Po => x pk ^ x k . (28) 

□ 

Example 1 (External forcing ). Consider the system: 

x = JH'(x) + f(t) (29) 

where the Hamiltonian H is (0, &oo)-subquadratic, and the forcing term is a 
distribution on the circle: 

f=jF + f Q with F £ L 2 (M/T2Z; JR 2n ) , (30) 
where f := T _1 f(t)dt. For instance, 

/(*) = E s *z - ( 31 ) 

feeiN 

where 5k is the Dirac mass at t = k and £ £ M 2 ™ is a constant, fits the pre- 
scription. This means that the system x = JH'(x) is being excited by a series 
of identical shocks at interval T. 

Definition 1. Let A^t) and B^t) be symmetric operators in IR 2 ™, depending 
continuously on t £ [0, T], such that ^(t) < B^t) for all t. 

A Borelian function H : [0, T] x IR 2 " — > IR is called (A^, B^-subquadratic 



at infinity if there exists a function N(t, x) such that: 

H(t,x) = ^{A 00 (t)x,x)+N(t,x) (32) 

Vt , N(t, x) is convex with respect to x (33) 

N(t,x) > n(\\x\\) with n(s)s^ 1 -> +oo as s -> +oo (34) 

3c£H: H(t,x) < ^ (Boo(t)a;,a;) +c Vx . (35) 



If Aoo(t) = a^I and B^t) = b^I , with < b^ £ IR, we shall say that 
H is (aaojbooj-subquadratic at infinity. As an example, the function \\x\\ , with 
1 < a < 2, is (0, e)-subquadratic at infinity for every e > 0. Similarly, the 
Hamiltonian 

H(t,x) = h\\kf + \\x\\ a (36) 
is (k, k + e)-subquadratic for every e > 0. Note that, if k < 0, it is not convex. 
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Notes and Comments. The first results on subharmonics were obtained by Ra- 
binowitz in ?, who showed the existence of infinitely many subharmonics both 
in the subquadratic and superquadratic case, with suitable growth conditions 
on H'. Again the duality approach enabled Clarke and Ekeland in ? to treat 
the same problem in the convex-subquadratic case, with growth conditions on 
H only. 

Recently, Michalek and Tarantcllo (see Michalek, R., Tarantello, G. ? and 
Tarantcllo, G. ?) have obtained lower bound on the number of subharmonics of 
period kT, based on symmetry considerations and on pinching estimates, as in 
Sect. 5.2 of this article. 
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